Eecient Associative Memory Using Small-world Architecture
نویسندگان
چکیده
Most models of neural associative memory have used networks with broad connectivity. However, from both a neurobiological viewpoint and an implementation perspective, it is logical to minimize the length of inter-neural connections and consider networks whose connectivity is predominantly local. The \small-world networks" model described recently by Watts and Strogatz provides an interesting approach to this issue. In this paper, we show that associative memory networks with small-world architectures can provide the same retrieval performance as randomly connected networks while using a fraction of the total connection length.
منابع مشابه
Efficient associative memory using small-world architecture
Most models of neural associative memory have used networks with broad connectivity. However, from both a neurobiological viewpoint and an implementation perspective, it is logical to minimize the length of inter-neural connections and consider networks whose connectivity is predominantly local. The `small-world networksa model described recently by Watts and Strogatz provides an interesting ap...
متن کاملHigh Capacity, Small World Associative Memory Models NEIL DAVEY, LEE CALCRAFT and ROD ADAMS
Models of associative memory usually have full connectivity or if diluted, random symmetric connectivity. In contrast, biological neural systems have predominantly local, non-symmetric connectivity. Here we investigate sparse networks of threshold units, trained with the perceptron learning rule. The units are given position and are arranged in a ring. The connectivity graph varies between bein...
متن کاملThe impact of connectivity on the memory capacity and the retrieval dynamics of Hopfield-type networks
Most models of neural associative memory have used networks with broad connectivity. However, this seems unrealistic from a neuroanatomical perspective. A simple model of associative memory with emergent properties was introduced by Hopfield [5]. We choose this widely known model to investigate the impact of connectivity on the storage capacity and the retrieval dynamics in artificial associati...
متن کاملInvestigation of Associative Memory by Small World Hopfield Neural Network with Characteristics of Social Network
In the Hopfield Neural Network (HNN), each neuron is connected to every other neuron. Thereby, the HNN causes high cost to generate the network in terms of implementation. Small World Hopfield Neural Network (SWHNN) improves ability for transmission by introducing the shortcut connections into the sparse regular network. However the storage ability of the SWHNN decreases for associative memory ...
متن کاملA Scalable Bit - Sequential SIMD Array for Nearest - NeighborClassi cation using the City - Block
We present a fully scalable SIMD array architecture for a most eecient implementation of pattern classiication by nearest-neighbor algorithms using the city-block metric. The elementary accumulator cell is highly optimized for a sequential accumulation of absolute integer diierences, so that several hundreds of them can be easily integrated on a single chip. A two-dimensional M N array structur...
متن کامل